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In this presentation, we will develop a short overview of main trends of optimiza- 
tion in systems and control, and from there outline some new perspectives emerging 
today. More specifically, we will focus on the current situation, where it is clear that 
convex and Linear Matrix Inequality (LMI) methods have become the most common 
option. However, because of its vast success, the convex approach is often the only 
direction considered, despite the underlying problem is non-convex and that other op- 
timization methods specifically equipped to handle such problems should have been 
used instead. We will present key points on this topic, and as a side result we will 
propose a method to produce a virtually infinite number of papers. 

After the origins of optimal control in the late fifties, championed by the works 
of Pontryagin and Bellman, the general intent was to try to find (almost) closed-form 
expressions for the considered problems. This perspective was pursued within the 
frameworks of Ricatti/Lyapunov equations approaches, with for instance the famous 
solution of Kalman for the LQ(R) problem. This period can be referred to as that of 
state-space methods and of so-called 'modern control'. A summary about this trend 
can be found in the introduction of [24] (see also ref. therein), and main results of 
that research direction are summarized for instance in [21 [5] . 

Somewhere in the eighties, the interest shifted to the more general framework of 
problems that can be formulated under the standard form of (nonlinear continuous) 
optimization problems: 

min f(x) 

(1) 

s.t. x e fl c E" 

Such problems do not admit in general an analytical solution and must be solved 
through iterative methods. Problems of the type of (1) can be split between convex 
problems, where f{x) and fl are convex, and non-convex problems, where f(x) and/or 
n are non-convex. The field of nonlinear programming, concerned with solving (1), 
is made of both these subsets. The classical reference book of that field is [4], an 
alternative being [T4] . 

The success of convexity. We recommend the first chapter of [T5] for a clear 
and summarized but nevertheless quite comprehensive presentation of the main con- 
cepts and results of convex optimization. More detailed and formal presentations 
are developed in the following three fundamental books [HI O [7] , that are the main 
references on convex programming (see also [4j [14] , including convex programming) . 
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The great strength and main interest of convex optimization is that: 

All locally optimal solutions of a convex problem are also globally optimal. 

This can be easily proven by observing that all locally optimal solutions must 
belong to the same convex set with the same objective value, which are then also 
globally optimal (see [7J Subsec. 4.2.3]). Moreover, most convex problems can be 
solved in polynomial time (cfr. e.g. [T3]). 

The main class of convex problems is those that are classified as Semi-Definite 
Programs (SDPs). These problems can be defined by a linear objective function and 
by constraints admitting a Linear Matrix Inequality (LMI) representation: 

T 

mm c x 

(2) 

s.t.F(x) < 0, 

where c £ R ra and the LMI is defined as F(x) — Fq + Y^i=i^i x ii where all 
matrices F belong to § fc , the set of symmetric k x k matrices (F(x) ^ means that 
the maximum real part of the eigenvalues of F[x) must be negative or zero). 

This class of problems is now the most often considered when trying to solve a 
problem of optimization in systems and control. 

There exist some historical introductions presenting the apparition and develop- 
ment of LMIs in systems and control. The most comprehensive is that given in the 
three pages of [6j Sec. 1.2.] (see also [TH Subsec. 1.4.6]). We will not copy this here 
and recommend these pages to the reader. The last crucial result of this development 
are the interior point methods extended by Nesterov and Nemirovsky to SDPs, in a 
most effective fashion (see [TS] and [3], the initial result was presented in 1988 in [TB]V 
Since then, many efficient solvers are available to solve SDPs (see Sedumi, LMILab, 
SDPT3 and other algorithms listed for instance in [5]). 

The availability of such solvers had the consequence in control of, as stated in 
[18] : "a significant paradigm shift: Instead of arriving at an analytical solution of 
an optimal control problem and implementing such a solution in software so as to 
synthesize optimal controllers, the intention is to reformulate a given control problem 
to verifying whether a specific linear matrix inequality is solvable or, alternatively, to 
optimizing functionals over linear matrix inequality constraints." . The article [2 3) is 
also recommended for more observations on this line. 

The trend of the development of LMIs in control is still booming today. This 
explosion can be quantified for instance with the number of articles with the keyword 
LMI in the IEEEXplore databas^: This explosion began around 1991-1994 (between 
the books [3 [6]), the 1st January 2009 there were 3133 cumulative hits and around 
5300 hits at the beginning of April 2012. 

Most of the main classical results of LMI formulations of systems and control 
optimization problems are presented in [5J [THl [Tg] . 

Non-convex problems and methods. An undesirable drawback of the success 
and large domination of convex optimization in systems and control is that it regularly 
happens that this direction is the only option considered, even though the underlying 
problem is non-convex (as such, or after de-approximating it). 

A classical situation is that of trying to solve non-convex problems with iterative 
LMI algorithms (ILMIs), which could also be labelled as Sequential SDPs (SSDPs), 
where a convex subproblem/approximation of the original problem is solved at each 



See http://www.eeci-institute.eu/pdf/M016/lmiI2.pdf , p. 9 for a graph. 
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iteration of the algorithm. The first issue with these schemes is that they often lack 
any good theoretical convergence guarantee (for instance, when the only guarantee is 
that the sequence of objective values is monotonously non-increasing). The second 
issue is that they may face significant practical difficulties, probably in terms of im- 
plementation, but more importantly in terms of numerical conditioning issues that 
may lead to a slow or no progress of the objective function. 

Instead, what should have been considered are genuine non-convex optimization 
methods, i.e. methods that have a guarantee of convergence to stationary points and 
that are efficient in practice. There are two main classes of such methods: the gradient- 
based methods and the derivative-free methods. The current points are presented in 
a still summarized but more detailed fashion in |22j . 

o The trend of exploiting gradient-based methods to solve fundamental non- 
convex problems of optimization in systems and control is not new. In our opinion, the 
most significant such results have been developed in the 2000s in parallel by Michael 
Overton and Pierre Apkarian and their coworkers. Relying on Rockafellar [T7] and 
Clarke |10j non-smooth variational analysis, they developed non-smooth optimization 
methods that converge to locally optimal solutions for fixed-order (thus non-convex) 
control design problems. Two particularly visible contributions are the control design 
methods HIFOO [T3] (using the solver HANSO) and hinf struct [T]. The importance 
of these results and methods must be emphasized, and we strongly recommend the 
many related fundamental works of these authors. 

o Next to the gradient-based approach, there exist a second alternative that is 
apparently nearly unknown in systems and control. More precisely, what appears 
currently unacknowledged in this field is that there now exist strong convergence 
guarantees for a class of derivative-free optimization methods, thanks to which it is 
now justifiable to rely on such methods to solve non-convex optimization problems. 
For a one-paragraph summary of these guarantees, see |22j . For a fuller presentation, 
see the book jllj . the first " comprehensive treatment'' of derivative-free methods. Note 
however that using these methods makes sense when the gradient information (of part 
of the objective function or the constraints) is not available (at all, or accurately, 
or at an acceptable computing cost). Also ideally, to keep short computing times 
with current desktop computers (e.g. <2-3 min), the number of variables should be 
reasonable (e.g. <25) and/or the objective function should be evaluated efficiently 
(e.g. <ls), or the method may be stopped before full convergence. 

Several examples of the efficiency of derivative-free methods on control design 
problems are available in the (soon-to-be released, in September 2012) PhD thesis 
[2Tj . An appetizer is available in [23] (see hyperlinks and files therein) , other different 
benchmarks (for which HIFOO and hinf struct can be used) are given in [20] (see 
also the example in the hyperlinked presentation). Such examples will be drawn in 
the presentation, which will also be posted on arXiv. 

To prompt a lively debate, we provide hereunder a 2 or 3 steps method to produce 
a virtually infinite amount of papers. This method relies on the assumption that 
obtaining a convex problem necessarily imply some measure of approximation of the 
original (engineering) problem (what is convex in this imperfect world?). 

1. Pick a paper where a problem is solved via LMI/convex optimization. 

2. (Optional) Rewrite the problem, so as to be less conservative with respect to 
the objective actually sought, and/or the constraints actually encountered. 

3. In the typical situation where the problem is non-convex, solve it via an 
adequate non-convex optimization method. 
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The step 2. is optional in the sense that the problem in the step 1. may already be 
non-convex, but that a convex approach (such as an ILMI/SSDP) is proposed for it. 

The convex approach really becomes unavoidable when the number of variables 
of the original problem is too great and/or when the actual problem is convex (which 
occurrences are often largely academic) . We also remark that the solution returned by 
the convex optimization can be used as initial solution for the non-convex problem (as 
suggested e.g. in [7J Subsec. 1.4.3]). This may be helpful, or not. That is, randomly 
chosen (but feasible) initial solutions may be just as useful, in which case the convex 
optimization can be skipped entirely. 
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